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Abstract. The gravitational wave signature from binary black hole coalescences 
is an important target for LIGO and VIRGO. The Numerical INJection Analysis 
(NINJA) project brought together the numerical relativity and gravitational wave 
data analysis communities, with the goal to optimize the detectability of these events. 
In its first instantiation, the NINJA project produced a simulated data set with 
numerical waveforms from binary black hole coalescences of various morphologies 
(spin, mass ratio, initial conditions), superimposed to Gaussian colored noise at the 
design sensitivity for initial LIGO and VIRGO. We analyzed this simulated data set 
with the Q-pipeline burst algorithm. This code, designed for the all-sky detection 
of gravitational wave bursts with minimal assumptions on the shape of the waveform, 
filters the data with a bank of sine-Gaussians, or sinusoids with Gaussian envelope. The 
algorithm's performance was compared to matched filtering with ring-down templates. 
The results are qualitatively consistent; however due to the low simulation statistics in 
the first NINJA project, it is premature to draw quantitative conclusions at this stage. 
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1. The NINJA Project 



The Numerical INJection Analysis (NINJA) project [HE] is a collaboration of numerical 
relativists and gravitational- wave data analysts, with the goal to improve detectability 
of binary black hole (BBH) coalescences with numerical relativity waveforms. The first 
NINJA project represented an important step towards the use of numerical waveforms 
to enhance the performance of data analysis. Nine numerical relativity groups shared 
waveforms for BBH coalescences, with no restrictions on spin, eccentricity, or mass 
ratio, and ten data analysis groups analyzed them with various methods based on both 
modeled (i.e. matched-filtering) and un-modeled searches. Numerical relativity can 
now provide complete coalescence waveforms, from inspiral to ring-down of the final 
remnant, through the merging of the black hole constituents of the binary system. A 
recent review of the status of binary black hole simulations is available in [3]. In the 
absence of signals from real sources, these waveforms offer a unique opportunity to test 
the data analysis search pipelines for efficiency in detection and faithfulness in source 
parameter estimations. The collaboration has been open to all scientists interested in 
numerical simulations. 

To model the detector, Gaussian noise time series have been generated, colored 
with the design sensitivity of each of the LIGO [H [5], and VIRGO [6] detectors. Non- 
Gaussian noise transients and narrow band features like violin and mirror modes, typical 
of real detector noise, are not included. A population of simulated gravitational signals 
has also been produced, from numerical relativity data. Such population covers a broad 
range of black hole masses, distances and orientations. For the numerical waveforms 
that were used see [Zl El El [101 El E21 ESI [HI HSl HH HH [HI [HI [201 [2H [22] , for descriptions 
of the numerical codes see [231 EH ESI H21 EHl EH HH1 [281 EHl EDI EH [22] . For details on 
the parameters, we refer to [H [2]. 

Matched filtering of the noise data endowed with simulated signals have been 
performed with analytical waveform models of the inspiral stage, from Post-Newtonian 
expansion [32], and with hybrid models of the full coalescence, created by matching 
Post-Newtonian perturbation templates with numerical relativity waveforms [33]. In 
addition, matched filtering to ring-down waveforms targeted high mass systems: the 
larger the mass of the black holes, the smaller is the frequency of the coalescence. Since 
the ring-down is at higher frequencies than the chirp signal from the inspiral, ring-down 
templates are particularly useful to detect the high mass BBH systems. Un-modeled 
searches, that do not rely on templates, have been performed with the Q-pipeline and 
Hilbert Huang Transform [34]. Parameter estimation techniques were also tested on 
this data set [351 EE]. For details and comparisons on the analysis pipelines and their 
performance in the NINJA project, see [1]. 

This paper compares the performance in the first NINJA project of two algorithms, 
developed by the LIGO Scientific Collaboration (LSC) for searches of bursts and ring- 
downs: Q-pipeline [371 ES [39] and lalappsjring [301 EI]- The algorithms are applied to 
the output of a single simulated detector, Hanford LIGO, whose data span a duration 
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of little over 30 hours. Sec. [21 describes the analysis, sec. [3] presents the results, and 
conclusions are drawn in sec. HI 

2. The Analysis 

In this section we provide some detail on the two algorithms we used in this study, and 
how they are implemented. 

2.1. Burst techniques: Q-pipeline 

The Q-pipeline (33, [38] is one of the algorithms used by the LIGO Scientific Collaboration 
(LSC) in the search for gravitational wave bursts [12]. It is a multi-resolution 
time-frequency search for statistically significant excess signal energy, equivalent to 
a templated matched filter search for sinusoidal Gaussians in whitened data. The 
template bank is constructed to cover a finite region in central time, central frequency, 
and quality factor Q q , the number of oscillations under the gaussian envelope, which, up 
to a constant, is the ratio of central frequency to bandwidth of the signal. The mismatch 
between any sinusoidal Gaussian in this signal space and the nearest basis function does 
not exceed a maximum mismatch of 20% in energy. For this study, as in [42], the data 
is analyzed in 64 sec blocks, in the frequency range 48-2048 Hz, with Q q between 3.3 
and 100. 

2.2. Matched filtering to ring-downs 

The lalappsjring [40j HI] code has been developed by the LSC for ring-down matched 
filtering searches. For this study, we used the same version as in the LIGO S4 ring-down 
analysis [431 HI] • The template bank is made of sinusoids with given frequency damped 
with an exponential, covering the parameter range 50-2000 Hz in frequency and 2-20 in 
Q r d, being Q r< j n times the damping time in unit of the sinusoid period. The analysis is 
performed in overlapping blocks of 2176 seconds; the low-frequency cutoff is 45 Hz for 
the LIGO noise curves and 35 Hz for the VIRGO noise curve. 

2.3. Analysis strategy 

The ultimate goal of this study is a multi-detector analysis, inclusive of a coherent 
followup that checks for sky location, and an event-by-event comparison of triggers from 
inspiral, burst and ring-down analyses, to explore the three phases of the coalescence, 
using Q-pipeline, lalapps_ring and inspiral matched filtering triggers produced by one 
of the other NINJA analysis teams [I]. 

However, for the first NINJA release, we forewent the coherent followup step and 
instead focused on single-detector results: we established a nominal threshold signal-to- 
noise ratio (SNR) of 5.5 and estimated parameters from the two pipelines to nominal 
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parameters: the time of the waveform maximum T pea k, the innermost stable circular 
orbit (ISCO) and ring-down frequencies /isco an d /ring [^5l B6| W7 \ 148]: 

c 3 

/isco 



6y/QirG(mi + m 2 ) ' (1) 

^ = 2^51? I 1 " °' 63(1 " a) °' 3 ] 

where G is the Newton constant, c the speed of light, m 1>2 the individual constituent 
masses and a, M are the final black hole dimension-less spin and mass calculated 
as in [49] and [50], respectively. The injected SNR is computed from the signal 
before injection and mean detector noise spectrum with starting frequency as specified 
in sec. I2.2L The threshold choice is consistent with S4 ring-down and S5 burst 
analyses [42l 144] . A more accurate threshold selection would require a study of 
accidentals and a fine tuning that goes beyond the scope of this initial study. 



3. Results 



Unless otherwise stated, all the results discussed in the following sections are restricted 
to the 4 km Hanford detector (HI): given the limited statistics (94 signals injected with 
SNR> 5.5), a full discussion of all interferometers would not reliably provide further 
insight in addition to the information presented below. 



3.1. Detection Performance 

The NINJA project paper [1] provides a comparative analysis of the different methods 
employed (inspiral, hybrid and ring-down templates for matched filtering, Q-pipeline and 
Hilbert Huang transform for burst searches). Here we focus on the analysis performed by 
un-modeled search via the Q-pipeline and by the matched-filtered one using ring-down 
templates, both at the single interferometer level, with the same nominal threshold of 
SNR moasure d > 5.5. The statistics of this sample is too small to make inferences on 
which pipeline performs better in which parameter region; a more systematic study 
is needed to assess the power of the methods. Also, this analysis does not take into 
account the effect of background noise transients and accidental coincidences, which are 
very different in real data than in Gaussian noise, so this comparison is not complete. 
Nevertheless we have an indication that all pipelines have comparable chances to find 
these signals. 

Figure [T] shows plots of all the injections used in the NINJA project as a function 
of injected SNR and total mass, identifying which were missed and found by Q-pipeline 
and lalapps_ring, respectively; black circles are injections found with SNR> 5.5, the red 
stars are missed. Out of 94 signals with injected SNR> 5.5, 88 (88) were found by Q- 
pipeline (lalapps_ring) and 89 (87) were found by Q-pipeline or (and) lalapps_ring with 
measured SNR> 5.5. A comparison of the difference between injected and measured 
SNRs can be seen in Figure [2, where we plot the SNR detected respectively by the Q- 
pipeline and the ring-down search as a function of the injected SNR. Notice that in both 
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Figure 1. Injections that were missed (stars) and found (circles) by Q-pipcline (left) 
and by the ring-down matched filtering (right) in HI as a function of SNR and total 
mass. For both algorithm, the condition for an injection to be found is that the 
measured signal-to- noise ratio is SNR measure d > 5.5. 




Figure 2. SNR detected by by Q-pipeline (left) and by the ring-down matched filtering 
(right) as a function of injected SNR for found injections. Dashed lines indicate a 
deviation from the diagonal by a factor of 



cases the detected SNR is smaller than the injected SNR (for SNRs above threshold), 
which is consistent with Q-pipeline detecting only a portion of the signal. There are few 
event at the detection threshold where the detected SNR is larger than injected SNR, 
due to noise fluctuation near threshold. For stronger signals, the discrepancy between 
measured and injected SNR is roughly within a factor of y/2, indicated by the dashed 
lines in Figure [2j 

To compare the detection efficiency of Q-pipeline with lalapps_ring, in Figure [3] we 
also plot the SNR recovered by lalapps_ring against the one recovered by Q-pipeline. 
Note that Q-pipeline finds injections with a slightly larger SNR; however, the detection 
performance of the two algorithms is relatively consistent. Here, the same detection 
threshold SNR > 5.5 was used for both searches; in a real search, different thresholds 
may be needed for the two algorithms, depending on the false alarm rate. 
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Figure 3. SNR detected by matched filtering to ring-down templates as a function of 
SNR detected by Q-pipeline for found injections. 




qpipe Tmeas - Twfpeak [ms] 



Figure 4. Timing accuracy of detected injection by ring-down search versus Q- 
pipclinc. 



3.2. Parameter Estimation 

The Q-pipeline identifies a central time for the detected event, corresponding to the peak 
time for the sine-Gaussian waveform with largest SNR, while the ring-down matched 
filtering algorithm reports as event time the beginning of the ring-down template with 
best match to the data. Figure H] shows the deviation of these two time measurements 
from the peak time of the injected waveform. The two algorithms are in agreement, 
with a single outlier, visible in the plot. This event corresponds to a weak injection, 
close to threshold; in this case, the ring-down code triggered on a startup transient of 
the signal, 90 ms before the merger. 

The Q-pipeline algorithm returns a frequency corresponding to the central 
frequency of the most significant tile in the time-frequency domain. This frequency, 
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Figure 5. Frequency as a function of mass. Red squares are the frequency returned 
by Q-pipeline (left) and lalapps_ring (right); In both figures, blue triangles are /isco; 
green stars are /ring- 



35 
30 

DC 25 



5 



L 








c 


) 






o 


t ° 


















o 

f 

v- 










c 


3 

i o 




o 


: o 




o- 

o 






c 


> 

Le 




o 




oo 




t 


) 


c 


) 






§ 


; 


o 

o o 


c 


) 


o 

> 


£ 


8 

;o 

if 




% 

o 


L 


» 


X 

, , , 




, , , 




, , , 


r , , l , , i 


o 





0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2 
Total Spin 



Figure 6. Missed (red stars) and found (black circles) injections for Q-pipcline versus 
modulus of the total spin a measured in dimension-less spin unit a = (^§jr + > 
being Si the individual spin vectors. 



as well as the ring-down frequency from the matched filtering search, are plotted in 
Figure [5], along with /isco and /ring, calculated from the injected parameters according 
to Equation [TJ for comparison. Note that for both algorithms the recovered frequency 
tends to be from the portion of the coalescence waveform in the most sensitive region 
of the detector (50-200Hz): the inspiral (in blue) for lower masses, and the ring-down 
(green) for higher masses. This can be well explained as ISCO and ring-down frequencies 
are inversely proportional to the total mass of the binary system so, as injection masses 
increase and frequencies decrease, the portion of the signal falling into the best sensitivity 
region of the detectors move from the inspiral to the ring-down part of the signal, the 
largest frequency for any given pair of masses and spins. For the parameters tested in 
this study, both algorithms detect signals between feco an d /ring- 
Finally in Figure [6] we show the SNR of missed and found injections for Q-pipeline 
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as a function of the sum of the spin of the constituents the binary system, each spin being 
measured in units of individual mass squared: this plot shows no obvious dependence 
of the detectability on the spin of the black holes. 

4. Conclusions 

In the context of the Numerical INJection Analysis (NINJA) project, the Q-pipeline 
burst search algorithm successfully analyzed numerical relativity BBH coalescence 
waveforms for a variety of masses, spins and eccentricities in simulated colored Gaussian 
noise. The Q-pipeline single interferometer performance is comparable to matched 
filtering to ring-down templates, and yields similar arrival time and frequency, and 
a slightly better SNR. In particular, depending on the total mass of the BBH system, 
both algorithms trigger between light-ring and ring-down over the broad parameter 
space covered by NINJA. We emphasize this is a qualitative statement: the statistics of 
the NINJA data set is too small for a quantitative, systematic comparison. Moreover 
the absence of the non-Gaussian noise transients typical of real detectors does not allow 
a realistic estimation of the false alarm rate and threshold settings. Systematic studies 
will be subjects of future NINJA projects. 

5. Acknowledgments 

The authors thank the NINJA collaboration for sharing waveforms and simulated data 
and for useful discussion in the definition of the problems and interpretation of results. 
This work was supported by grant NSF PHY-0653550 and by the Istituto Nazionale di 
Fisica Nucleare (INFN). 

This paper was assigned number LIGO Document Control Center number P0900068. 



Un-modeled search for black hole binary systems in the NINJA project 



8 



References 

[1] Aylott B et at, "Testing gravitational- wave searches with numerical relativity waveforms: Results 

from the hrst Numerical INJection Analysis (NINJA) project" , larXiv:0901. 43991 [gr-qc] 
[2] Cadonati L et al. 2009 Class. Quantum Grav. 26 114008 
[3] Hannam M 2009 Class. Quantum Grav. 26 114001 
[4] Abbott B et al. (LIGO Scientific) 2007 (Preprint [0711 . 304 ip 

[5] Smith J, for the LIGO Scientific Collaboration 2009 Class. Quantum Grav. 26 114013 

[6] Acernese F et al. 2006 Class. Quantum Grav. 23 S635-S642 

[7] Bruegmann B et al. 2008 Phys. Rev. D 77 024027 (Preprint [gr-qc/0610128| 

[8] Husa S, Gonzalez J A, Hannam M, Bruegmann B and Sperhake U 2008 Class. Quant. Grav. 25 

105006 (Preprint [0706 .0740p 
[9] Alcubierre M et al. 2000 Phys. Rev. D 62 044034 [Preprint |gr-qc/000307ll ) 
[10] Alcubierre M et al. 2003 Phys. Rev. D 67 084023 [Preprint |gi-qc/0206072| 
[11] Koppitz M et al. 2007 Phys. Rev. Lett. 99 041102 [Preprint [gr-qc/0701163| 
[12] Pollney D et al. 2007 Phys. Rev. D 76 124002 (Preprint [0707 . 2559ft 

[13] Imbiriba B, Baker J, Choi D I, Centrclla J, Fiske D R, Brown J D, van Meter J R and Olson K 

2004 [Preprint |gr-qc/0403048| 
[14] van Meter J R, Baker J G, Koppitz M and Choi D I 2006 Phys. Rev. D 73 124011 [Preprint 

Igr^qc/OSOSOSOl ) 

[15] Zlochower Y, Baker J G, Campanelli M and Lousto C O 2005 Phys. Rev. D 72 024021 [Preprint 
^7^/05050551 ) 

[16] Campanelli M, Lousto C O, Marronetti P and Zlochower Y 2006 Phys. Rev. Lett. 96 111101 

(Preprint |gr-qc/05l"l 048) 
[17] Sperhake U 2007 Phys. Rev. D 76 104015 (Preprint |gr-qc/06060"79| 

[18] Hinder I. Vaishnav B, Herrmann F, Shoemaker D and Laguna P 2008 Phys. Rev. D 77 081502 

(Preprint 10710 . 5167]) 
[19] Prctorius F 2005 Class. Quant. Grav. 22 425-452 (Preprint |gr-qc/0407lTol ) 
[20] Prctorius F 2005 Phys. Rev. Lett. 95 121101 (Preprint [g"r-qc/05070"T4| ) 
[21] Schcel M A et al. 2006 Phys. Rev. D 74 104006 (Preprint [gr-qc/ 0607056) 

[22] Etienne Z B, Fabcr J A, Liu Y T, Shapiro S L and Baumgarte T W 2007 Phys. Rev. D 76 101503 
(Preprint 10707 .2083p 

[23] Hannam M, Husa S, Sperhake U, Bruegmann B and Gonzalez J A 2008 Phys. Rev. D 77 044020 
(Preprint 10706. 1305]) 

[24] Hannam M, Husa S, Bruegmann B and Gopakumar A 2008 Phys. Rev. D 78 104007 (Preprint 
10712.37870 

[25] Tichy W and Marronetti P 2008 Phys. Rev. D 78 081501 ( Prevrint [0807 . 2985p 
[26] Rezzolla L et al. 2008 Astrpphys. J679 1422-1426 (Prevrint [0708 . 3999p 

[27] Vaishnav B, Hinder I, Herrmann F and Shoemaker D 2007 Phys. Rev. D 76 084020 (Preprint 
[Q705.3829P 

[28] Buonanno A, Cook G B and Prctorius F 2007 Phys. Rev. D 75 124018 (Preprint [gr-qc /0610122| 
[29] Prctorius F and Khurana D 2007 Class. Quant. Grav. 24 S83-S108 (Preprint [gr-qc/07020"84] 
[30] Boyle M et al. 2007 Phys. Rev. D 76 124038 (Preprint 10710 . 0158P 
[31] Schcel M A et al. 2008 (Preprint 10810 .1767P 

[32] Santamaria L, Krishnan B and Whelan J 2009 Class. Quantum Grav. 26 114010 

[33] Farr B, Fairhurst S and Sathyaprakash B S 2009 Class. Quantum Grav. 26 114009 

[34] Stroeer A and Camp J 2009 Class. Quantum Grav. 26 114012 

[35] Aylott B, Vcitch J and Vccchio A 2009 Class. Quantum Grav. 26 114011 

[36] Raymond V et al 2009 Class. Quantum Grav. 26 114007 

[37] Chatterji S, "The search for gravitational-wave bursts in data from the second LIGO science run", 
Ph.D. Thesis, MIT Dept. of Physics, 2005 



Un-modeled search for black hole binary systems in the NINJA project 



9 



[38] Chatterji S, Blackburn L, Martin G, Katsavounidis E, "Multiresolution techniques for the detection 
of gravitational-wave bursts", Class. Quantum Grav. 21 (2004) S1809 (proceedings of the 8th 
Gravitational Wave Data Analysis Workshop) , |arXiv: gr-qc /0412119] 

[39] https: / / geco.phys.columbia.edu/omega 

[40] https:/ /www. lsc-group.phys.uwm.edu/daswg/projects/lal. html 

[41] Crcighton J D E, "Search techniques for gravitational waves from black-hole ringdowns", 1999 
Phys. Rev. D 60 022001 

[42] Abbott B P for the LSC, "Search for gravitational- wave bursts in the first year of the fifth LIGO 

science run" larXiv:0905.0020l 
[43] Goggin L M, "A search for gravitational waves from perturbed black hole ringdowns in LIGO 

data", Ph.D. Thesis, California Institute of Technology, 2008 
[44] Abbott B P for the LSC, "Search for gravitational wave ringdowns from perturbed black holes in 

LIGO S4 data" . larXiv:0905.1654l [gr-qc] 
[45] Kidder L E, Will C M, Wiseman A G, "Spin effects in the inspiral of coalescing compact binaries", 

Phys Rev D 47 4183 (1993) [arXiv:gr-qc/9211925] 
[46] Echeverria F, "Gravitational-wave measurements of the mass and angular momentum of a black 

hole", 1989 Phys. Rev. D 40 3194 
[47] Goggin L for the LSC, "Search for black hole ringdown signals in LIGO S4 data", 2006 Class. 

Quantum Grav. 23 S709-S713 
[48] Leaver E W, "Spectral decomposition of the perturbation response of the Schwarzschild geometry" , 

1986 Proc. R. Soc. A 402 285 
[49] Rezzolla L et al, "On the final spin from the coalescence of two black holes", gr-qc 0712.3541; 

Rezzolla L et al, "The final spin from the coalescence of aligned-spin black-hole binaries" , 

Phvs.Rcv.D78:044002.2008, larXiv:0710.3345l [gr-qc] 
[50] Buonanno A et al. 2007 Phys. Rev. D 76 104049 (Preprint 10706 .3732p 



